Voicify Your UI

Nowadays, voice assistants help users complete tasks on the smartphone with commands, replacing traditional touchscreen interactions when such are inhibited. However, usability of those tools remains moderate due to problems in understanding rich language variations human along efficiency and comprehensibility issues. Therefore, we introduce Voicify, an Android virtual assistant that allows interact on-screen elements mobile apps through commands. Using a novel deep learning command parser, Voicify interprets verbal input performs matching UI elements. In addition, tool can directly open specific feature from installed applications by fetching application code information explore set in-app components. Our parser achieved 90\% accuracy dataset. Furthermore, direct invocation module achieves better coverage comparison Google Assistant. The user study demonstrates usefulness real-world scenarios.